Instance-Specific Feature Propagation for Referring Segmentation
نویسندگان
چکیده
Referring segmentation aims to generate a mask for the target instance indicated by natural language expression. There are typically two kinds of existing methods: one-stage methods that directly perform on fused vision and features; two-stage first utilize an model proposal then select one these instances via matching them with features. In this work, we propose novel framework simultaneously detects target-of-interest feature propagation generates fine-grained mask. our framework, each is represented Instance-Specific Feature (ISF), target-of-referring identified exchanging information among all ISFs using proposed Propagation Module (FPM). Our instance-aware approach learns relationship objects, which helps better locate than methods. Comparing methods, collaboratively interactively utilizes both synchronous identification segmentation. experimental tests, method outperforms previous start-of-the-art three RefCOCO series datasets.
منابع مشابه
Shape-aware Instance Segmentation
We address the problem of instance-level semantic segmentation, which aims at jointly detecting, segmenting and classifying every individual object in an image. In this context, existing methods typically propose candidate objects, usually as bounding boxes, and directly predict a binary mask within each such proposal. As a consequence, they cannot recover from errors in the object candidate ge...
متن کاملRecurrent Instance Segmentation
Instance segmentation is the problem of detecting and delineating each distinct object of interest appearing in an image. Current instance segmentation approaches consist of ensembles of modules that are trained independently of each other, thus missing opportunities for joint learning. Here we propose a new instance segmentation paradigm consisting in an end-to-end method that learns how to se...
متن کاملAmodal Instance Segmentation
We consider the problem of amodal instance segmentation, the objective of which is to predict the region encompassing both visible and occluded parts of each object. Thus far, the lack of publicly available amodal segmentation annotations has stymied the development of amodal segmentation methods. In this paper, we sidestep this issue by relying solely on standard modal instance segmentation an...
متن کاملSparse Motion Segmentation using Propagation of Feature Labels
The paper considers the problem of extracting background and foreground motions from image sequences based on the estimated displacements of a small set of image blocks. As a novelty, the uncertainty of local motion estimates is analyzed and exploited in the fitting of parametric object motion models which is done within a competitive framework. Prediction of patch labels is based on the tempor...
متن کاملPath Aggregation Network for Instance Segmentation
The way that information propagates in neural networks is of great importance. In this paper, we propose Path Aggregation Network (PANet) aiming at boosting information flow in proposal-based instance segmentation framework. Specifically, we enhance the entire feature hierarchy with accurate localization signals in lower layers by bottom-up path augmentation, which shortens the information path...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Multimedia
سال: 2022
ISSN: ['1520-9210', '1941-0077']
DOI: https://doi.org/10.1109/tmm.2022.3163578